Association Between Financial Incentives and Participant Deception About Study Eligibility.

Importance: Offers of payment for research participation are ubiquitous but may lead prospective participants to deceive about eligibility, jeopardizing study integrity and participant protection. To date, neither the rate of payment-induced deception nor the influence of payment amount has been systematically studied in a nationally representative randomized survey experiment. Objectives: To estimate payment-associated deception about eligibility for an online survey and to assess whether there is an association between payment amount and deception frequency. Design, Setting, and Participants: Randomized, 7-group survey experiment. Data were collected in March 2018 and analyzed from March to August 2018. The setting was a nationally representative online survey among US adults drawn from the GfK KnowledgePanel. Interventions: Varying payment amounts for participation ($5, $10, or $20 cash equivalent) and direction of eligibility criterion (having received or not having received an influenza vaccination in the past 6 months). Main Outcomes and Measures: Proportion of respondents reporting recent influenza vaccination. Results: In total, 2275 individuals participated in the survey, a 59.4% (2275 of 3829) response rate; 51.8% (1108) were female, and 21.1% of respondents (399) were aged 18 to 29 years, 24.9% (532) were aged 30 to 44 years, 26.0% (601) were aged 45 to 59 years, and 28.0% (738) were 60 years or older. For participants offered a $5 incentive, the reported frequency of recent influenza vaccination was 16.6% higher (95% CI, 9.1%-24.1%) among those told that eligibility (and thus payment) required recent vaccination than among those told that eligibility required no recent vaccination. The corresponding differences were 21.0% (95% CI, 13.5%-28.5%) among those offered $10 and 15.4% (95% CI, 7.8%-23.0%) among those offered $20. Estimated proportions of ineligible individuals who responded deceptively regarding eligibility ranged from 10.5% to 22.8% across study groups. There was no evidence that higher payment was associated with higher frequency of deception. Conclusions and Relevance: In a nationally representative randomized survey experiment to evaluate whether and to what extent payment is associated with participants misleading investigators about their research eligibility, this study found evidence of significant deception. However, no association was observed between payment amount and frequency of deception. Further research is needed to extend these findings to clinical research. These data suggest that, when possible, investigators should rely on objective tests of eligibility rather than self-report.

Using the CollaboraKTion framework to report on primary care practice recruitment and data collection: costs and successes in a cross-sectional practice-based survey in British Columbia, Ontario, and Nova Scotia, Canada.

BACKGROUND: Across Canada and internationally we have poor infrastructure to regularly collect survey data from primary care practices to supplement data from chart audits and physician billings. The purpose of this work is to: 1) examine the variable costs for carrying out primary care practice-based surveys and 2) share lessons learned about the level of engagement required for recruitment of practices in primary care. METHODS: This work was part of a larger study, TRANSFORMATION that collected data from three provincial study sites in Canada. We report here on practice-based engagement. Surveys were administered to providers, organizational practice leads, and up to 20 patients from each participating provider. We used the CollaboraKTion framework to report on our recruitment and engagement strategies for the survey work. Data were derived from qualitative sources, including study team meeting minutes, memos/notes from survey administrators regarding their interactions with practice staff, and patients and stakeholder meeting minutes. Quantitative data were derived from spreadsheets tracking numbers for participant eligibility, responses, and completions and from time and cost tracking for patient survey administration. RESULTS: A total of 87 practices participated in the study (n = 22 in BC; n = 26 in ON; n = 39 in NS). The first three of five CollaboraKTion activities, Contacting and Connecting, Deepening Understandings, and Adapting and Applying the Knowledge Base, and their associated processes were most pertinent to our recruitment and data collection. Practice participation rates were low but similar, averaging 36% across study sites, and completion rates were high (99%). Patient completion rates were similarly high (99%), though participation rates in BC were substantially lower than the other sites. Recruitment and data collection costs varied with the cost per practice ranging from $1503 to $1792. CONCLUSIONS: A comprehensive data collection system in primary care is possible to achieve with partnerships that balance researcher, clinical, and policy maker contexts. Engaging practices as valued community members and independent business owners requires significant time, and financial and human resources. An integrated knowledge translation and exchange approach provides a foundation for continued dialogue, exchange of ideas, use of the information produced, and recognises recruitment as part of an ongoing cycle.

Does providing more services increase the primary hospitals' revenue? An assessment of national essential medicine policy based on 2,675 counties in China.

OBJECTIVE: To understand whether the increased outpatient service provision (OSP) brings in enough additional income (excluding income from essential medicine) for primary hospitals (INCOME) to compensate for reduced costs of medicine. METHODS: The two outcomes, annual OSP and INCOME for the period of 2008-2012, were collected from 34,506 primary hospitals in 2,675 counties in 31 provinces in China by the national surveillance system. The data had a four-level hierarchical structure; time points were nested within primary hospital, hospitals within county, and counties within province. We fitted bivariate five-level random effects regression models to examine correlations between OSP and INCOME in terms of their mean values and dose-response effects of the essential medicine policy (EMP). We adjusted for the effects of time period and selected hospital resources. FINDINGS: The estimated correlation coefficients between the two outcomes' mean values were strongly positive among provinces (r = 0.910), moderately positive among counties (r = 0.380), and none among hospitals (r = 0.002) and time (r = 0.007). The correlation between their policy effects was weakly positive among provinces (r = 0.234), but none at the county and hospital levels. However, there were markedly negative correlation coefficients between the mean and policy effects at -0.328 for OSP and -0.541 for INCOME at the hospital level. CONCLUSION: There was no evidence to suggest an association between the two outcomes in terms of their mean values and dose-response effects of EMP at the hospital level. This indicated that increased OSP did not bring enough additional INCOME. Sustainable mechanisms to compensate primary hospitals are needed.

Evaluating CollaboRATE in a clinical setting: analysis of mode effects on scores, response rates and costs of data collection.

BACKGROUND: Shared decision-making (SDM) has become a policy priority, yet its implementation is not routinely assessed. To address this gap we tested the delivery of CollaboRATE, a 3-item patient reported experience measure of SDM, via multiple survey modes. OBJECTIVE: To assess CollaboRATE response rates and respondent characteristics across different modes of administration, impact of mode and patient characteristics on SDM performance and cost of administration per response in a real-world primary care practice. DESIGN: Observational study design, with repeated assessment of SDM performance using CollaboRATE in a primary care clinic over 15 months of data collection. Different modes of administration were introduced sequentially including paper, patient portal, interactive voice response (IVR) call, text message and tablet computer. PARTICIPANTS: Consecutive patients ≥18 years, or parents/guardians of patients <18 years, visiting participating primary care clinicians. MAIN MEASURES: CollaboRATE assesses three core SDM tasks: (1) explanation about health issues, (2) elicitation of patient preferences and (3) integration of patient preferences into decisions. Responses to each item range from 0 (no effort was made) to 9 (every effort was made). CollaboRATE scores are calculated as the proportion of participants who report a score of nine on each of the three CollaboRATE questions. KEY RESULTS: Scores were sensitive to mode effects: the paper mode had the highest average score (81%) and IVR had the lowest (61%). However, relative clinician performance rankings were stable across the different data collection modes used. Tablet computers administered by research staff had the highest response rate (41%), although this approach was costly. Clinic staff giving paper surveys to patients as they left the clinic had the lowest response rate (12%). CONCLUSIONS: CollaboRATE can be introduced using multiple modes of survey delivery while producing consistent clinician rankings. This may allow routine assessment and benchmarking of clinician and clinic SDM performance.

The effect of a monetary incentive for administrative assistants on the survey response rate: a randomized controlled trial.

BACKGROUND: There is sufficient evidence that monetary incentives are effective in increasing survey response rates in the general population as well as with physicians. The objective of this study was to assess the impact of a monetary incentive intended for administrative assistants on the survey response rate of physicians in leadership positions. METHODS: This was an ancillary study to a national survey of chairs of academic Departments of Medicine in the United States about measuring faculty productivity. We randomized survey participants to receive or not receive a $5 gift card enclosed in the survey package. The cover letter explained that the gift card was intended for the administrative assistants as a "thank you for their time." We compared the response rates between the 2 study arms using the Chi-square test. RESULTS: Out of 152 participants to whom survey packages were mailed to, a total of 78 responses were received (51 % response rate). The response rates were 59 % in the incentive arm and 46 % in the no incentive arm. The relative effect of the incentive compared to no monetary incentive was borderline statistically significant (relative risk (RR) = 1.36, 95 % confidence interval (CI) 0.99 to 1.87; p = 0.055). CONCLUSION: Monetary incentives intended for administrative assistants likely increase the response rate of physicians in leadership positions.

Simplified Asset Indices to Measure Wealth and Equity in Health Programs: A Reliability and Validity Analysis Using Survey Data From 16 Countries.

BACKGROUND: Social franchising programs in low- and middle-income countries have tried using the standard wealth index, based on the Demographic and Health Survey (DHS) questionnaire, in client exit interviews to assess clients' relative wealth compared with the national wealth distribution to ensure equity in service delivery. The large number of survey questions required to capture the wealth index variables have proved cumbersome for programs. METHODS: Using an adaptation of the Delphi method, we developed shortened wealth indices and in February 2015 consulted 15 stakeholders in equity measurement. Together, we selected the best of 5 alternative indices, accompanied by 2 measures of agreement (percent agreement and Cohen's kappa statistic) comparing wealth quintile assignment in the new indices to the full DHS index. The panel agreed that reducing the number of assets was more important than standardization across countries because a short index would provide strong indication of client wealth and be easier to collect and use in the field. Additionally, the panel agreed that the simplified index should be highly correlated with the DHS for each country (kappa ≥ 0.75) for both national and urban-specific samples. We then revised indices for 16 countries and selected the minimum number of questions and question options required to achieve a kappa statistic ≥ 0.75 for both national and urban populations. FINDINGS: After combining the 5 wealth quintiles into 3 groups, which the expert panel deemed more programmatically meaningful, reliability between the standard DHS wealth index and each of 3 simplified indices was high (median kappa = 0.81, 086, and 0.77, respectively, for index B that included only the common questions from the DHS VI questionnaire, index D that included the common questions plus country-specific questions, and index E that found the shortest list of common and country-specific questions that met the minimum reliability criteria of kappa ≥ 0.75). Index E was the simplified index of choice because it was reliable in national and urban contexts while requiring the fewest number of survey questions-6 to 18 per country compared with 25 to 47 in the original DHS wealth index (a 66% average reduction). CONCLUSION: Social franchise clinics and other types of service delivery programs that want to assess client wealth in relation to a national or urban population can do so with high reliability using a short questionnaire. Future uses of the simplified asset questionnaire include a mobile application for rapid data collection and analysis.

Factores determinantes y coste económico del absentismo de pacientes en consultas externas de la Agencia Sanitaria Costa del Sol / Determinants and economic cost of patient absenteeism in outpatient departments of the Costa del Sol Health Agency

Fundamento: Identificar los factores de la persona, el proceso y el contexto que influyen en el cumplimiento de las citas de consultas externas en la Agencia Sanitaria Costa del Sol, describiendo el perfil del paciente que no acude a su cita, los motivos del absentismo y realizando una estimación del coste económico. Método: Estudio observacional, multicéntrico de casos y controles, mediante encuesta a pacientes citados en consultas ambulatorias durante 2013 y 2014 y análisis de costes por consultas. Resultados: Participaron en el estudio 882 pacientes (294 casos y 588 controles). El olvido (29,6%; n=87) y el fallo en la comunicación (16%; n=47), fueron los principales motivos manifestados por los pacientes absentistas. Una menor demora en la cita y la edad avanzada se asociaban significativamente con menos ausencias, al igual que haber frecuentado más las consultas en el último año. El coste económico fue superior a 3 millones de euros para una tasa de inasistencia del 13,8%. Conclusiones: Los pacientes jóvenes que no frecuentan habitualmente las consultas constituyen el grupo de mayor riesgo de ausencia a las citas programadas en nuestra área sanitaria. Los principales motivos del absentismo son evitables y podrían beneficiarse de intervenciones como la mejora de los procedimientos de comunicación o sistemas de recordatorio de citas (AU)

Background: To identify factors related to the people, the process and the context that determine patient compliance with their appointments in the ambulatory outpatient services in the Costa del Sol Health Care Agency; and to obtain the profile of patients who fail to keep their appointments, the reasons for this failure and an estimation of its economic cost. Methods: Observational multicenter case-control study, through a survey carried out on patients with an appointment in the ambulatory outpatient services during 2013 and 2014, and analysis of the cost per appointment. Results: In total, 882 patients participated in the study (294 cases and 588 controls). The main reasons for missing an appointment were forgetting about it (29, 6%; n=87), and failure in communication (16%; n=47). A shorter time period before the appointment and older age were significantly associated with fewer absences, as well as the fact of having attended more consultations in the past year. The economic cost was more than 3 million euros for a non-attendance rate of 13.8%. Conclusions: Young patients who usually do not visit outpatient clinics are at greatest risk of absence from scheduled appointments in our health area. The main reasons for absenteeism are preventable and interventions such as improved communication procedures or appointment reminder systems could be beneficial (AU)

Patients' perceptions of the costs of total hip and knee arthroplasty.

With medical economics in the national sociopolitical spotlight, we conducted a study to assess patients' understanding of the cost of 2 common orthopedic procedures: total hip and knee arthroplasty (THA, TKA). We surveyed 284 consecutive THA or TKA patients, at their first postoperative visit, regarding their understanding of reimbursement and cost. On average, patients estimated surgeon reimbursement at $12,014. They estimated that the hospital was reimbursed $28,392 for their perioperative care and that it cost the hospital $24,389 to provide it. The cost of the implant used was estimated at $6447. There is wide variation in patients' estimates and understanding of health care costs. However, patients substantially overestimate reimbursement to the surgeon both in isolation and as a proportion of the total cost of the surgical procedure.

Demographic factors and hospital size predict patient satisfaction variance--implications for hospital value-based purchasing.

BACKGROUND: Hospital Value-Based Purchasing (HVBP) incentivizes quality performance-based healthcare by linking payments directly to patient satisfaction scores obtained from Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) surveys. Lower HCAHPS scores appear to cluster in heterogeneous population-dense areas and could bias Centers for Medicare & Medicaid Services (CMS) reimbursement. OBJECTIVE: Assess nonrandom variation in patient satisfaction as determined by HCAHPS. DESIGN: Multivariate regression modeling was performed for individual dimensions of HCAHPS and aggregate scores. Standardized partial regression coefficients assessed strengths of predictors. Weighted Individual (hospital) Patient Satisfaction Adjusted Score (WIPSAS) utilized 4 highly predictive variables, and hospitals were reranked accordingly. SETTING: A total of 3907 HVBP-participating hospitals. PATIENTS: There were 934,800 patient surveys by the most conservative estimate. MEASUREMENTS: A total of 3144 county demographics (US Census) and HCAHPS surveys. RESULTS: Hospital size and primary language (non-English speaking) most strongly predicted unfavorable HCAHPS scores, whereas education and white ethnicity most strongly predicted favorable HCAHPS scores. The average adjusted patient satisfaction scores calculated by WIPSAS approximated the national average of HCAHPS scores. However, WIPSAS changed hospital rankings by variable amounts depending on the strength of the predictive variables in the hospitals' locations. Structural and demographic characteristics that predict lower scores were accounted for by WIPSAS that also improved rankings of many safety-net hospitals and academic medical centers in diverse areas. CONCLUSIONS: Demographic and structural factors (eg, hospital beds) predict patient satisfaction scores even after CMS adjustments. CMS should consider WIPSAS or a similar adjustment to account for the severity of patient satisfaction inequities that hospitals could strive to correct.

National Survey of Providers Treating Patients With Metabolic Disorders Identified by Newborn Screening Demonstrates Challenges Faced by Clinical Care Systems.

OBJECTIVES: To evaluate care processes for infants who are identified by newborn screening (NBS) and diagnosed with metabolic disorders during their first year of life. METHODS: A survey instrument was used to assess the scope and intensity of services needed to provide quality health care for patients from birth to 1 year of age who have a metabolic disorder identified by NBS. Significance testing was not performed; descriptive analyses are reported. RESULTS: Providers spend significant amounts of time on activities that are not direct patient care. The most challenging aspect of their work was the lack of reimbursement for care. CONCLUSION: Provision of genetics services for patients with a metabolic disorder is time and labor intensive, and insurance coverage and reimbursement for these services remain inadequate. Health care payment and/or system reform is necessary to provide optimal care to patients with metabolic disorders identified by NBS.

[Autonomy for financial management in public and private healthcare facilities in Brazil]. / Autonomia financeira em estabelecimentos públicos e privados de saúde no Brasil.

Autonomy in financial management is an advantage in public administration. A 2009 National Healthcare Facility Survey showed that 3.9% of Brazil's 52,055 public healthcare facilities had some degree of financial autonomy. Such autonomy was more common in inpatient facilities (17.8%), those managed by State governments (26.3%), and in Southern Brazil (6.6%). Autonomy was mainly partial (for resources in specific areas, relating to small outlays, consumables and capital goods, and outsourced services or personnel). 74.3% of 2,264 public facilities with any financial autonomy were under direct government administration. Financial autonomy in public healthcare facilities appears to be linked to local political decisions and not necessarily to the facility's specific legal and administrative status. However, legal status displays distinct scopes of autonomy - those under direct government administration tend to be less autonomous, and those under private businesses more autonomous; 85.8% of the 45,394 private healthcare facilities reported that they were financially autonomous.

How do people attribute income-related inequalities in health? A cross-sectional study in Ontario, Canada.

CONTEXT: Substantive equity-focused policy changes in Ontario, Canada have yet to be realized and may be limited by a lack of widespread public support. An understanding of how the public attributes inequalities can be informative for developing widespread support. Therefore, the objectives of this study were to examine how Ontarians attribute income-related health inequalities. METHODS: We conducted a telephone survey of 2,006 Ontarians using random digit dialing. The survey included thirteen questions relevant to the theme of attributions of income-related health inequalities, with each statement linked to a known social determinant of health. The statements were further categorized depending on whether the statement was framed around blaming the poor for health inequalities, the plight of the poor as a cause of health inequalities, or the privilege of the rich as a cause of health inequalities. RESULTS: There was high agreement for statements that attributed inequalities to differences between the rich and the poor in terms of employment, social status, income and food security, and conversely, the least agreement for statements that attributed inequalities to differences in terms of early childhood development, social exclusion, the social gradient and personal health practices and coping skills. Mean agreement was lower for the two statements that suggested blame for income-related health inequalities lies with the poor (43.1%) than for the three statements that attributed inequalities to the plight of the poor (58.3%) or the eight statements that attributed inequalities to the privilege of the rich (58.7%). DISCUSSION: A majority of this sample of Ontarians were willing to attribute inequalities to the social determinants of health, and were willing to accept messages that framed inequalities around the privilege of the rich or the plight of the poor. These findings will inform education campaigns, campaigns aimed at increasing public support for equity-focused public policy, and knowledge translation strategies.

The effect of response scale, administration mode, and format on responses to the CAHPS Clinician and Group survey.

OBJECTIVE: To examine how different response scales, methods of survey administration, and survey format affect responses to the CAHPS (Consumer Assessment of Healthcare Providers and Systems) Clinician and Group (CG-CAHPS) survey. STUDY DESIGN: A total of 6,500 patients from a university health center were randomly assigned to receive the following: standard 12-page mail surveys using 4-category or 6-category response scales (on CG-CAHPS composite items), telephone surveys using 4-category or 6-category response scales, or four-page mail surveys. PRINCIPAL FINDINGS: A total of 3,538 patients completed surveys. Composite score means and provider-level reliabilities did not differ between respondents receiving 4-category or 6-category response scale surveys or between 12-page and four-page mail surveys. Telephone respondents gave more positive responses than mail respondents. CONCLUSIONS: We recommend using 4-category response scales and the four-page mail CG-CAHPS survey.

National trends in psychotropic medication use in young children: 1994-2009.

OBJECTIVE: To examine recent national trends in psychotropic use for very young children at US outpatient medical visits. METHODS: Data for 2- to 5-year-old children (N = 43 598) from the 1994-2009 National Ambulatory and National Hospital Ambulatory Medical Care Surveys were used to estimate the weighted percentage of visits with psychotropic prescriptions. Multivariable logistic regression was used to identify factors associated with psychotropic use. Time effects were examined in 4-year blocks (1994-1997, 1998-2001, 2002-2005, and 2006-2009). RESULTS: Psychotropic prescription rates were 0.98% from 1994-1997, 0.83% from 1998-2001, 1.45% from 2002-2005, and 1.00% from 2006-2009. The likelihood of preschool psychotropic use was highest in 2002-2005 (1994-1997 adjusted odds ratio [AOR] versus 2002-2005: 0.67; 1998-2001 AOR versus 2002-2005: 0.63; 2006-2009 AOR versus 2002-2005: 0.64), then diminished such that the 2006-2009 probability of use did not differ from 1994-1997 or from 1998-2001. Boys (AOR versus girls: 1.64), white children (AOR versus other race: 1.42), older children (AOR for 4 to 5 vs 2 to 3 year olds: 3.87), and those lacking private insurance (AOR versus privately insured: 2.38) were more likely than children from other groups to receive psychotropic prescriptions. CONCLUSIONS: Psychotropic prescription was notable for peak usage in 2002-2005 and sociodemographic disparities in use. Further study is needed to discern why psychotropic use in very young children stabilized in 2006-2009, as well as reasons for increased use in boys, white children, and those lacking private health insurance.

Disparities in health insurance among children with same-sex parents.

OBJECTIVES: The objectives of this study were to examine disparities in health insurance coverage for children with same-sex parents and to investigate how statewide policies such as same-sex marriage and second-parent adoptions affect children's private insurance coverage. METHODS: We used data from the 2008-2010 American Community Survey to identify children (aged 0-17 years) with same-sex parents (n = 5081), married opposite-sex parents (n = 1369789), and unmarried opposite-sex parents (n = 101678). We conducted multinomial logistic regression models to estimate the relationship between family type and type of health insurance coverage for all children and then stratified by each child's state policy environment. RESULTS: Although 77.5% of children with married opposite-sex parents had private health insurance, only 63.3% of children with dual fathers and 67.5% with dual mothers were covered by private health plans. Children with same-sex parents had fewer odds of private insurance after controlling for demographic characteristics but not to the extent of children with unmarried opposite-sex parents. Differences in private insurance diminished for children with dual mothers after stratifying children in states with legal same-sex marriage or civil unions. Living in a state that allowed second-parent adoptions also predicted narrower disparities in private insurance coverage for children with dual fathers or dual mothers. CONCLUSIONS: Disparities in private health insurance for children with same-sex parents diminish when they live in states that secure their legal relationship to both parents. This study provides supporting evidence in favor of recent policy statements by the American Academy of Pediatricians endorsing same-sex marriage and second-parent adoptions.

Medicare program; FY 2014 hospice wage index and payment rate update; hospice quality reporting requirements; and updates on payment reform. final rule.

This final rule updates the hospice payment rates and the wage index for fiscal year (FY) 2014, and continues the phase out of the wage index budget neutrality adjustment factor (BNAF). Including the FY 2014 15 percent BNAF reduction, the total 5 year cumulative BNAF reduction in FY 2014 will be 70 percent. The BNAF phase-out will continue with successive 15 percent reductions in FY 2015 and FY 2016. This final rule also clarifies how hospices are to report diagnoses on hospice claims, and provides updates to the public on hospice payment reform. Additionally, this final rule changes the requirements for the hospice quality reporting program by discontinuing currently reported measures and implementing a Hospice Item Set with seven National Quality Forum (NFQ) endorsed measures beginning July 1, 2014, as proposed. Finally, this final rule will implement the hospice Experience of Care Survey on January 1, 2015, as proposed.

Surveying clinicians by web: current issues in design and administration.

The versatility, speed, and reduced costs with which web surveys can be conducted with clinicians are often offset by low response rates. Drawing on best practices and general recommendations in the literature, we provide an evidence-based overview of methods for conducting online surveys with providers. We highlight important advantages and disadvantages of conducting provider surveys online and include a review of differences in response rates between web and mail surveys of clinicians. When administered online, design-based features affect rates of survey participation and data quality. We examine features likely to have an impact including sample frames, incentives, contacts (type, timing, and content), mixed-mode approaches, and questionnaire length. We make several recommendations regarding optimal web-based designs, but more empirical research is needed, particularly with regard to identifying which combinations of incentive and contact approaches yield the highest response rates and are the most cost-effective.

The right tool for the right job: the value of alternative patient experience measures.

Patient-reported experience of care predicts health care outcomes. Fourteen US and Canadian practices intercalated a standard ambulatory care Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey within their usual Internet-based survey to compare results from the Internet survey, Internet CAHPS survey, and a mailed CAHPS survey. They found that practice performance rankings obtained via the multi-item CAHPS survey were equivalent to a single measure captured by the Internet survey.

Measures of quality, costs and equity in primary health care instruments developed to analyse and compare primary care in 35 countries.

BACKGROUND: The Quality and Costs of Primary Care in Europe (QUALICOPC) study aims to analyse and compare how primary health care systems in 35 countries perform in terms of quality, costs and equity. This article answers the question 'How can the organisation and delivery of primary health care and its outcomes be measured through surveys of general practitioners (GPs) and patients?' It will also deal with the process of pooling questions and the subsequent development and application of exclusion criteria to arrive at a set of appropriate questions for a broad international comparative study. METHODS: The development of the questionnaires consisted of four phases: a search for existing validated questionnaires, the classification and selection of relevant questions, shortening of the questionnaires in three consensus rounds and the pilot survey. Consensus was reached on the basis of exclusion criteria (e.g. the applicability for international comparison). Based on the pilot survey, comprehensibility increased and the number of questions was further restricted, as the questionnaires were too long. RESULTS: Four questionnaires were developed: one for GPs, one for patients about their experiences with their GP, another for patients about what they consider important, and a practice questionnaire. The GP questionnaire mainly focused on the structural aspects (e.g. economic conditions) and care processes (e.g. comprehensiveness of services of primary care). The patient experiences questionnaire focused on the care processes and outcomes (e.g. how do patients experience access to care?). The questionnaire about what patients consider important was complementary to the experiences questionnaire, as it enabled weighing the answers from the latter. Finally, the practice questionnaire included questions on practice characteristics. DISCUSSION: The QUALICOPC researchers have developed four questionnaires to characterise the organisation and delivery of primary health care and to compare and analyse the outcomes. Data collected with these instruments will allow us not only to show in detail the variation in process and outcomes of primary health care, but also to explain the differences from features of the (primary) health care system.